Method of relaying digital video &amp; audio data via a communication media

ABSTRACT

A method of relaying digital video data over a communications medium such as the Internet is provided where accelerated relaying time can be realised. The method involves assembling digital data of one frame representing a scene of a video image plus data of one or more filters and parameters therefor to be applied to the digital data over a plurality of repeated frames of that scene. All that data is relayed to a users personal computer and then an apparent video movie is generated at the personal computer over a plurality of repeated frame images of the one frame by applying the filters thereto. The filters can include PAN ZOOM FADE etc., so that when applied over the plurality of frames each of the same scene, there will be an apparent motion video movie. Many scenes and filters can be employed to enhance the video. In providing a video of real estate, such as details of an apartment, a 2-D floor plan of the apartment can also be relayed so that a viewer of the apparent video can obtain a better understanding of the image being viewed at any given point of time. The 2-D floor plan can have a route-of-path line drawn thereon to further enhance the understanding of the image being viewed. A moving indicator can be displayed over the route-of-path which can be approximately synchronised with the apparent video to give an approximate indication on the route-of-path for the image being viewed at any given point of time.

FIELD OF THE INVENTION

The present invention relates to a method of relaying digital video andaudio data over a communications medium and relates particularly but notexclusively to such in an Internet environment.

DESCRIPTION OF PRIOR ART

Hitherto, when digital motion video data has been relayed on acommunication medium such as the Internet, it has been usual for theduration of the motion video to be kept to a minimum because of the slowspeed of the Internet transmission process and the very large size ofthe files necessary to transmit the video content. Because of the slowspeed of the Internet, such as 28.8 k or 56 k, and the large file size,it has meant that a motion video image of image size of say 60×60pixels, and 15 seconds duration can take up to 10 minutes or more to bedownloaded. This is generally considered unacceptable. The resultantimage quality is also generally considered unacceptable. Moreover, thewidth and height size is kept as small as possible to reduce the filesize. Further, the frame rate is sometimes reduced from NTSC 30 framesper second or PAL 25 frames per second, to around 15 frames per secondto again reduce the file size. In some instances, the picture detail ofthe video image is traded off by having low resolution images andconsequential relatively smaller file sizes. Generally, transmission ofmotion video via the Internet has not been entirely satisfactory owingto the large transmission times needed to transmit the entire videocontent. The problem is further exacerbated if audio is to accompany themotion video transmission as the audio files are in general “wave” filesand digital files in this format also have a very large file size.

It is generally acknowledged that the large file size of a video filecan be reduced by a suitable compression codec such as an MPEG (MotionPicture Expert Group) codec or other codecs. The “wave” files can besimilarly suitably compressed. In some motion video applications, videodata and audio file data are interleaved, such as in the. AVI Video forWindows file format. In general, these techniques have not elevatedvideo transmission over the Internet to a position where it can beconsidered as an efficient commercial option.

Several attempts have been made to provide enhanced video transmissionover the Internet. For example, U.S. Pat. No. 5,132,792 describes asystem that uses a frame dropping processes to remove predeterminedframes from a transmission. In general, the more frames that aredropped, the more efficiently the video signals are transmitted however,this tends to deteriorate video quality by providing jerky videomovement. Accordingly, this solution has limited application.

OBJECT AND STATEMENT OF THE INVENTION

The present invention attempts to overcome one or more of theaforementioned problems by a completely different technique. In thistechnique one or more frames are relayed together with data of filtersand parameters therefor to be applied to the one or more frames. Whenreceived, the data of one or more frames is then self generating overmany frames with filters such as ZOOM, PAN, FADE etc., applied overthose frames and this results in an apparent motion video image in thefinal video. As a consequence of the relayed data, the resultant motionvideo is generated at receivers personal computers. This substantiallyshortens the transmission time. An example of the invention hasparticular application in relaying motion video and audio data via theInternet. The video and audio content is particularly suited forproviding motion video information in relation real estate where motionvideo of buildings/apartments can be received by intending purchasers toobtain a first hand viewing before making a physical site inspection ora purchase. In the case of use in a real estate environment, the systemalso enables a 2-D floor plan of the real estate to be provided and awalk through path provided on the 2-D floor plan indicating the pathtaken of a person walking through the real estate as the video plays.This, in turn, gives an apparent indication of the position in the realestate at any given instant of the viewed video. Whilst the inventionhas particular application in conveying video information concerningreal estate the invention should not be considered limited thereto as ithas application in many other fields.

Accordingly to a first broad aspect of the present invention there isprovided a method of relaying digital video data,

said method involving providing a set of digital data of one framerepresenting a scene of a video image, assembling data of one or morefilters and parameters therefor to be applied to the digital data over aplurality of repeated frames of that scene,

relaying the digital data and the data of the filters and parameterstherefor from one location to another location over a communicationsmedium,

and at said another location receiving and reproducing the digital dataover the plurality of repeated frames with the one or more video filtersand parameters therefor applied whereby to generate at the anotherlocation an apparent video movie over those reproduced video frames andwhereby the transmission time over the transmission medium is less thanthat required to transmit digital data of a video movie of the samecontent if digital data of all of those reproduced video frames weretransmitted.

Preferably, the communication medium is the Internet.

Preferably, the filters include one or more of ZOOM, PAN, TILT, DISTORT,MORPH, FADE and other effect filters.

Preferably, the video content is of a two dimensional area and a floorplan of that area is simultaneously displayed at said another locationtogether with a route-of-path over the 2-D area, and a marker indicatoris provided which progresses along the route-of-path in accordance withthe particular image being viewed in the video whereby to provide anapparent location of where the image is being viewed at any given time.

Preferably, audio data is also transmitted from the one location to saidanother location so that when the video is generated at said anotherlocation, the audio component can be reproduced with the videocomponent.

BRIEF DESCRIPTION OF THE DRAWINGS

In order that the invention can be more clearly ascertained a preferredexample for use in a real estate environment will now be described withreference to the accompanying drawings wherein:

FIG. 1 is a block schematic diagram showing functional descriptions ofprocesses involved;

FIGS. 2a through 2 e are a series of diagrams time synchronised to oneanother showing:

In FIG. 2a, a type of video time-line for three scenes;

In FIG. 2b, a time duration for each of the scenes;

In FIG. 2c, a duration, commencement and end times for varioustransition filters;

In FIG. 2d, a time-line representation of further filters; and

In FIG. 2e, timing points T1 and T2 of the end of scene 1 and start ofscene 2, and the end of scene 2 and the start of scene 3;

FIG. 3 is a 2-D floor plan of real estate and a walk throughroute-of-path therein;

FIG. 4 is a diagram of a viewing preview window on a receiving computer;

FIGS. 5, 6 and 7 show diagrams of the image sizes of the scenes 1, 2 and3;

FIGS. 8 and 9 show interconnected functional diagrams of a “productionsystem” and connection with the Internet; and

FIGS. 10 through 12 show functional diagrams of a user connecting withthe Internet and downloading video and audio files and subsequentlyreproducing the video/audio at the users PC.

Referring firstly to FIG. 1 it can be seen that the preferred method foruse in a real estate environment is implemented in a system whichcomprises three primary blocks comprising:

a production system 1, the Internet 2 as a communication medium, and oneor more receiving computers 3. Whilst FIG. 1 shows only video encodingin the production system 1, it should be understood that both video andaudio can be encoded and used in the method. In a broader sense, onlyvideo may be encoded and transmitted without audio. A video server 20 isprovided as a means to store the video/audio data relating to individualitems of real estate which can be accessed by receiving computers 3.

Reference will firstly be made to FIGS. 2a through 2 e, and FIGS. 3through 7 in order to obtain an understanding of the system. Referencewill then be made again to FIG. 1, and then to FIGS. 8 through 12 for adetailed explanation of other aspects of the system.

Firstly, it should be understood that the motion video image which auser observes at a monitor of a receiving computer 3 is generated at thereceiving computer 3. There is no corresponding video at the videoserver 20 but rather information which can be utilised to enable areceiving computer 3 to self generate a motion video sequence from stillframe images.

In a very simple system, if a video sequence to be observed by a personon a monitor of a receiving computer 3 is to be say 20 seconds long, thevideo sequence could be made up from a single still frame picture image.

In other words, if the video frame rate is 15 frames per second then thevideo could be made up from 15×20 identical images. A video of thatnature would not appear to have any motion when viewed on a monitor of areceiving computer 3 because all frames would be identical in content.For this video it is only necessary to transmit one frame of the pictureframe image and then to self generate the remaining frames at thereceiving computer. Accordingly, in the simple system referred to above,digital data representative of the image of a single frame can berelayed over the transmission medium—the Internet 2—and received in areceiving computer 3, and then the computer 3 will self generate thevideo locally. The video image then viewed by a viewer on the monitorscreen of a receiving computer 3 would appear as a stationary image forthe duration of the video—20 seconds.

If motion is to be observed in the video content then an apparent movingvideo image can be created by the self generation at the receivingcomputer 3 if that receiving computer 3 knows how to manipulate thevideo image of the single still frame for each particular frame of the20 second period duration.

Accordingly, when a video image is created for relaying over thetransmission medium by the production system 1, it is also produced withinformation concerning the way the image is to be manipulated.Throughout the specification we refer to the way in which the videoimage is manipulated by the use of term “filters”. These filters cancomprise one or more of ZOOM, PAN, TILT, DISTORT, MORPH, FADE etc andalso transition effect filters, as will be discussed in relation to amore complex example.

If it is assumed that a ZOOM filter is applied to the image of each ofthe frames in the video sequence, and that the zooming progresses fromone frame to the next frame etc over the duration of the video sequence,then an observer of a monitor screen on the receiving computer 3 willhave the impression of an apparent motion video sequence because theimage will appear to be changing.

Accordingly, it can be appreciated therefore, that the time taken torelay the single frame image, together with information concerning theduration of the proposed video sequence, and information concerning anyfilters to be applied, will be far less than that required to relay acomplete motion video sequence from the video server 20 where each frameis relayed one after the other. Thus, with the system that is proposed,the relaying time over the transmission medium is substantially lessthan that required to relay digital data of a motion video movie of thesame content if digital data of all those reproduced video frames weretransmitted.

If the video image of a still frame is compressed according to aparticular codec, further efficiencies can be obtained with regard tothe relaying time over the communications medium.

The codec used for compression of the still frame image of the scene canbe any particular codec and is not limited solely to MPEG or JPEG or thelike. However, it is preferred to use a JPEG compression codec as it isreadily available and operates reasonably satisfactorily.

FIG. 2a shows a type of video time-line representation of three scenes.It can be seen that scene 1 is an image of a hallway, scene 2 an imageof a living room, and scene 3 an image of a bedroom. In FIG. 3 there isshown a floor plan in 2-D format of real estate in the form of anapartment scene 1, being the hallway, and this is diagrammatically shownas having a picture image plane represented by plane A. Scene 2, being aliving room, is represented by a picture image plane B. Scene 3, being abedroom, is represented by a picture image plane C. Thus, in order toprovide an apparent video of the apartment, three picture frame imagesA, B and C are provided to provide a total video sequence of a durationof 11 seconds. This is shown in FIG. 2B. The duration of the hallwayvideo part of the total video sequence has a duration of 5 seconds. Theduration of the living room part of the video has a duration of 2seconds. The bedroom part of the total video sequence has a duration of4 seconds. The time-line shown in FIG. 2a shows only the first and lastframes of each of the individual video parts. It also shows that thevideo part for the living room buts with the video part for the hallway.It also shows that the bedroom part of the video buts with the livingroom part of the video.

FIG. 2c shows a transition in the form of a “RIGHT/LEFT SLIDE WIPE” atthe end of the hallway video and the start of the living room video. Italso shows a similar transition at the end of the living room video, andthe start of the bedroom video. The time durations of the transitionshave been arbitrarily shown as 1 second and 0.75 seconds respectively.The transitions could occur over any given time period. Desirably, for a“SLIDE WIPE TRANSITION” which is from right to left, the apparent wipespeed should approximate the apparent speed of a person walking throughthe apartment along a route-of-path P (see FIG. 3). Thus, in theexamples, shown in FIG. 2c with the particular transitions shown, thetransition from the living room to the bedroom is slightly faster thanthe transition from the hallway to the living room. This will have theapparent effect in the video of a person walking quicker at thetransition between the living room and the bedroom than at thetransition between the hallway and the living room. The transitions areinterpreted herein as certain filters.

FIG. 2d shows that for a 2.5 second period of the hallway video there isa ZOOM IN filter applied and that for the remaining 2.5 second period ofthat video, there is a PAN filter applied. The PAN filter also extendsfor a period of 1 second into the living room video. It next shows aZOOM IN transition for the remaining 1 second period of the living roomvideo and that that ZOOM IN filter is applied for a 0.5 second periodover the bedroom video. It also shows that for a further 1.5 secondperiod of the bedroom video, a ZOOM OUT filter is applied and that forthe balance of the 2 second bedroom video there is a PAN left to rightfilter applied.

Referring now to FIG. 4 it can be seen that a preview window 4 isavailable on the monitor screen of a receiving computer 3. Typically,this preview window can have any size and any aspect ratio. It has beenarbitrarily shown as having a height of 180 and a width of 180 pixelsbut of course any desired size and aspect ratio could be utilised. FIG.5 shows the size of the image for the hallway image which has a heightof 180 and a width of 1900 pixels. These dimensions are also arbitrarybut because the height 180 equals the height 180 of the preview window4, the height images correspond with what will be displayed in thepreview window 4.

Similar arrangements are shown in FIGS. 6 and 7 for the images of theliving room and of the bedroom. In each case the height is still 180whereas the lengths are 1400, and 1700 respectively. Each of theseimages is available at each frame in the total video sequence for thehallway video part, the living room video part, and the bedroom videopart respectively. Because the widths are greater than the previewwindow width then it is possible to provide relative movement betweenthe preview window 4 and the images of the hallway, the living room, andthe bedroom, to give an apparent movement by applying a PAN filter. Ifthe height of the images of each of the hallway video, living room videoand bedroom video were greater than 180 it would be possible to PAN upor DOWN as well. If PANNING is effected past the sides and or top orbottom of the images then there will be MASKS appearing in the previewwindow which is undesirable. The intention is to provide an apparentcontinuous video through the preview window 4 and any MASKS which wouldoccur as a result of over PANNING would destroy the apparent videomotion.

Summarising, the preview window has particular dimensions for width andheight, and the particular images in each frame for the hallway part ofthe video, the living room part of the video, and the bedroom part ofthe video have a much greater width than the width of the previewwindow. Accordingly, it is possible for a relative PANNING motion toappear through the preview window 4 by scanning across the respectiveimages. As each frame in the video section for the hallway, the livingroom, and the bedroom, are respectively identical, there will appearthrough the preview window an image, which represents a ZOOMING down thehallway, a PAN from left to right with a transition of a SLIDE WIPEbetween scene 2 and scene 1 representing movement into the living room.There will then be a further ZOOM IN in the living room followed bycontinuous ZOOMING IN to the bedroom, with a SLIDE WIPE transitionbetween the living room and the bedroom. There will then be a ZOOM OUTin the bedroom followed by a further PAN left to right.

All of the above can be created at the receiving computer 3 by relayinga single picture frame image of each of the hallway scene, the livingroom scene, and the bedroom scene. Thus, only three single frame imagesneed to be relayed via the communications medium together withinformation concerning the duration of each of the video components,together with the particular filters which are applied, and the startand end times of the filters. Thus, it can be seen that one or morefilters are applied together with parameters therefor and that these areutilized at the receiving computer 3 to self generate an apparent videofrom only three single frame images. All the missing frames arereconstituted at the receiving computer 3 according to the parameters ofthe filters and the parameters associated with each of the respectiveframe images ie the time duration for each of the picture frame imagesin the video sequence.

Returning now to FIG. 3 it can be seen that an indicator arrowhead Z isshown on the route-of-path P. The arrowhead Z is caused to move alongthe route-of-path P as viewed on the monitor screen of a receivingcomputer 3 to provide an indication approximately where a viewer is inthe apartment. In other words, there is a 2-D floor plan of theapartment shown in FIG. 3 with a route-of-path P shown thereon and anarrowhead Z to indicate the approximate position at any given instantduring the playing of a video as observed through the preview window 4.FIG. 2e shows transition times T1 and T2 representing the transitionsbetween the hallway part of the video and the living room part of thevideo, and the living room part of the video and the bedroom part of thevideo respectively. These time periods T1 and T2 are used to tellcontrolling software which moves the arrowhead Z along the route-of-pathP that it is to change the direction at the transition time T1 or T2etc. Thus, as a viewer plays a video and operates conventional videoplayer stop, start, pause, rewind buttons which can be displayed on themonitor of the receiving computer 3 concurrently with the video, thevideo can be made to play, start or stop, pause etc. and the arrowhead Zwill assume a position along the route-of-path P which approximates theposition of a person on the route-of-path P at that time. Normally, thearrowhead Z moves continuously along the route-of-path P in accordancewith the playing of the video.

Clearly, an apparent video can be made up from a number of differentsingle frame images representing each of the rooms of an apartment orindeed any other area. A 2-D floor plan of the area can be providedtogether with a route-of-path which indicates the path of a personwalking through the area. The single picture frame images can be relatedto the position of the person walking through the area, and by applyingvarious filters there can be provided an apparent video of the 2-D area.

It should also be realised that the video can be of a 3-D volumedepending on the particular images of the single picture frames and theparticular PANS and other filters applied thereto. Thus, there can be anapparent three dimensional movement. In this case, other 2-Drepresentations can be provided to indicate vertical planes, and aroute-of-path can be shown on those planes in a similar manner to theroute-of-path on the 2-D plan format shown in FIG. 3. Thus, on themonitor screen of a receiving computer 3, there may be provided severaldiagrams similar to FIG. 3 but representing plan views, and sideelevational views etc. with appropriate route-of-paths drawn thereontogether with appropriate arrows on the routes-of-paths. The pictureimages can be assembled into a digital file together with the parametersrelating thereto, including the timing of the duration of each of thevideo components for each of the still frames and the various filtersapplied thereto. In the preferred embodiment we store this informationin a file with a .MSD file extension. The transition timing informationrelating to T1 T2 etc as referred to in relation to FIG. 2e is stored ina file with a .TRK extension. Data representative of the floor plan in2-D format as shown in FIG. 3 can be represented in a vector, bitmap orother compatible format as a file with a .MGM file extension. These fileextensions have arbitrarily been provided by ourselves however, any fileextensions can be utilized. Typically, the video picture images for eachframe are compressed according to the JPEG codec, although they may beuncompressed images such as in a bitmap file or other file.

Thus, when a receiving computer 3 makes contact with the video server 20via the Internet, it accesses these three types of file types and thenat the receiving computer 3 a video is generated from the still pictureframe images. If desired, audio may accompany the video .MSD files. Thisaudio may be compressed, if desired, according to a particular codec.Thus, when received at the receiving computer 3, it can be uncompressedby that codec.

Returning now to FIG. 1, and with particular reference to the productionsystem block 1, it can be seen that there is an editing block 10. Here,the particular still frame images used to create the entire video areassembled. In the case of the examples shown in relation to FIGS. 2athrough 2 e there are three scenes of picture images. These scene imagesare then presented to the video encoding block 15 where they arecompressed according to a particular codec such as the JPEG compressioncodec. The video server block 20 is provided to store all the data filesnecessary for the video display including the .MSD files, the .MGM filesand the .TRK files. Audio files may also be included. The video servertransmits all the files to a receiving computer 3 when a receivingcomputer 3 request the playing of a video from the Internet address siteof the server 20. When the request has been made from the receivingcomputer 3 to the video server 20, the downloading and decoding isidentified in the receiving computer 3 in decoding block 30. Thereceiving computer 3 will then wait for a request from a reply block 40to self generate a playable motion video from the digital data which hasbeen transmitted. This is shown in the self generation block 50. Thevideo and audio processor block 60 enables the video and audio from theself generated motion video to be displayed on the monitor of thereceiving computer 3. As discussed before, a video player arrangementcan be provided on the monitor screen to simulate the normal buttons ofa video recorder/player such as stop, play, pause, rewind etc. At thesame time as the video and audio processor 60 is processing data, thedraw walk-through-route block 65 processes the 2-D floor planinformation from the .MGM file and displays the route-of-path thereon.It also processes the TRK file which controls points of transition ofmovement of a position indicator in the shape of the arrowhead Z overthe route-of-path P. The draw walk through route block 65 can also checkto see if the video has played in its entirety such that the end block68 can automatically return the video to its start point for subsequentreplaying.

Referring now to FIG. 8 it can be seen that there are two subsectionblocks being create .MSD file 5, and create .TRK file 7. In the create.MSD file block, it is necessary to define some of the parametersrelating to the video information which is to be assembled. These are,project name (project name .MSD), preview window display area eg180×180, 240×180 etc. which represents the pixel size. This all occurswithin the block 70 which is a sub-block of the create .MSD file 5.

It is then necessary to import the still picture scenes in JPEG, TIFF,BITMAP, or other formats to a work space. This occurs in block 75 whichis a further sub-block of the create .MSD file 5. It is then necessaryto specify the duration of the video parts, and to apply effects to thestill picture scene images such as ZOOM IN, ZOOM OUT, PAN, FADE, MORPH,and the like, together with the various start times and end times forthose effects. It is also necessary to apply transition filters if theyare required, between the ends of the video portions made from each ofthe still picture images. These transitions may be PAN left to right,PAN right to left, PAN up and down, PAN down up, and other knowntransition filters. All of these filters are assembled in the block 80which is a sub-block of the create .MSD file 5.

In the create .TRK file block 7, a 2-D floor plan is firstly opened inthe sub-block 85. The 2-D floor plan can be a vector or bitmap baseddrawing and has been provided with a .MGM file extension as an arbitraryextension.

A route-of-path P is then drawn on the 2-D floor plan as a polyline thatis made up of one or more straight lines. The example in FIG. 3 showsthe walk through route-of-path P having three straight lines. As theroute-of-path P is to correspond to particular time instances relativeto the picture images in the .MSD files, it is necessary to manipulatethe route-of-path so it will fine tune and be in synchronisation withthe resultant video. At present this is done by trial and error bymanipulating the length of the individual straight lines in theroute-of-path and the particular angles of intersection. The timings T1and T2 etc at the change of direction points is also manipulatedslightly so that they approximately correspond with the resultant videoimage. This synchronisation is performed in block 95 in the create .TRKfile 7. The resultant information is then saved in a .TRK file in block97.

FIG. 9 shows a flow diagram of the functions associated with videoencoding block 15 where the picture data from the create .MSD file block5 is saved in an MSD file block 100. The resultant picture data, withthe video effects and timings in the .MSD file is then brought togetherwith the information in the .TRK file and copied into the video server20 in block 110. The information is saved in hard disk in the videoserver 20 and can be accessed via the Internet using TCP/IP protocol.

In the video encoding block 15, the still picture scene images arecompiled with effects and timings with a JPEG (Joint Photographic ExpertGroup) codec compression screen. This will reduce the .MSD file size byabout 25 times its original size. It will then be saved as a .MSD filefor viewing via the Internet. In the video server block 20, three kindsof files are copied to specific directories. These files are the .MGMfiles, .MSD files, and the .TRK files. Within the video server 20, aprogram is run to facilitate relaying of the three types of files ofeach video to the receiving computers as requested by using TCP/IPprotocol. A multi-thread system can be utilized to connect each of thereceiving computers 3 to each thread to facilitate requests from thereceiving computers 3. This will increase the efficiency of the videoserver 20 to the receiving computers 3. Typically the video server 20can be connected to the Internet using an ISDN line (eg 64 K to 384 Kbit-sec or higher capacity bandwidth line such as a fibre optic linewhich can have data transfer rates up to megabits/sec).

Referring now to FIG. 10 there is shown a breakdown of the decodingblock 30 which occurs within the receiving computer 3. Typically, thereceiving computers 3 are connected to the Internet via a modem dial-upor LAN based connection. The interacting software with the Media Serverprogram residing in the receiving computer 3 is an Internet BrowserPlug-in which is compatible with Microsoft Internet Explorer 3 and 4 andNetscape 3 and 4. It requests the necessary files ie .MGM, .TRK and .MSDfiles respectively from the server 20 using TCP/IP.

In the decoding block 30 (FIG. 10) there are two paths. One path is foraudio and the other path is for video. The audio is processed within theblocks 200 and 220 and the video is processed within the blocks 210 to230. Thus, the audio file which is pre-stored in the plug-in directoryof a receiving computer 3 when installing or updating of the Internetplug-in, so that for audio, an audio file is opened in block 200 and isassembled ready for playing in a buffer in block 220. The video isunpacked in block 210 and is decompressed using the JPEG codec in block230.

FIG. 11 is a flow diagram of the self generation block 50 shown in FIG.1. The 2-D floor plan is drawn onto the Internet browser window usingthe downloaded Internet plug-in written in C++ as it is received fromthe video server 20. Within the plug-in, there are interfaces that allowthe user of a receiving computer 3 to manipulate the 2-D floor plan suchas magnify or de-magnify and allows Play, Pause, and Stop functionswithin the block 235. The plug-in interface enables activation of thevideo by clicking either the play button or by directly clicking on theroute-of-path P polyline while still receiving unpacked .MSD files. The.MSD files will be decompressed and all the necessary frames to createthe video segment will be produced in the self generation block 50 inaccordance with the sub-block 250. The audio component begins playingconcurrently with any video and is synchronised with block 270 and block280.

FIG. 12 shows a flow diagram of the floor walk-through block 65 andshows that the display route is provided as a decision process as block300 and the arrow head Z is drawn on the 2-D floor plan in block 320.Interrogation is made at decision 330 whether the video has beencompleted in its entirety. If it has, the audio playback and audiobuffer are closed in block 340. If it has not the process re-loops.

Whilst the above system has been described for a particular applicationin relation to real estate, it should be appreciated that it can beapplied to other areas and fields and is not limited solely to realestate areas.

It should also be appreciated that audio files such as music files areloaded during installation of the plug-in. Any audio files can beupdated from time to time by simply reloading the plug-in once again.Many audio files such as music files can be loaded with the plug-in, andcan be arranged to be randomly selected during playing of a video, toprovide variation to the accompaniment of the video.

Particulars of some algorithms associated with certain filters are setout below:

ZOOM IN effect

Suppose:

1. Effect time: 0˜T

2. At time 0: Image is I(O,O,W,H)

W is the width of still picture

H is the height of still picture

3. At time T: Image is I(xT,yT,wT,hT)

xT is left position

yT is top position

wT is width

hT is height

Then at time t (from 0 to T): Image is I(x,y,w,h)

x=xT*t/T

y=yT*t/T

w=W−(W−wT)*t/T

h=H−(H−hT)*t/T

ZOOM OUT effect

Suppose:

1. Effect time: 0˜T

2. At time 0: Image is I(xT,yT,wT,hT)

xT is left position

yT is top position

wT is width

hT is height.

3. At time T: Image is I(O,O,W,H)

W is the width of still picture

H is the height of still picture

Then at time t (from 0 to T): Image is I(x,y,w,h)

x=xT*(T−t)/T

y=yT*(T−t)/T

w=W−(W−wT)*(T-t)/T

h=H−(H−hT)*(T-t)/T

FADE effect: (one picture fades in and another fades out)

Suppose:

1. Effect time: 0˜T

2. At time 0: Image is I(O,O,W,H)

W is the width of the still picture I

H is the height of the still picture I

3. At time T: Image is I′ (O,O,W,H)

Then at time t (from 0 to T): Image is i(O,O,W,H)

p(x,y) is the pixel value (colour or grayscale) in position (x,y)

if, I and I′ are 8-bits (256 colour or grayscale) Imagep(x,y)≈(pI(x,y)*t+pI′ (x,y)*(T−t))/T

else if I and I′ are true colour image

p(x,y)_R=(pI(x,y)_R*t+pI′ (x,y)_R*(T−t))/T

p(x,y)_G=(pI(x,y)_G*t+pI′ (x,y)_G*(T−t))/T

p(x,y)_B=(pI(x,y)_B*t+pI′ (x,y)_B*(T−t))/T

Last formula can be improved to reduce calculation time

PAN effect (from left to right)

Suppose:

1. Effect time: 0˜T

2. At time 0: Image is I(O,O,W,H)

W is the width of the still picture I

H is the height of the still picture I

3. At time T: Image is I′ (O,O,W,H)

Then at time t (from 0 to T): Image is i (O,O,W,H)

p(x,y) is the pixel value (colour or grayscale) in position (x,y)

if x+W*t/T<W

p(x,y)=pI(x+W*t/T,y) else

p(x,y)=PI′ (x+W*t/T−W, y)

Perspective Display effect:

Sometimes we display the picture on the screen with just a size change,however, we also can display the picture in rational distortion mode toproduce a perspective effect.

Suppose:

Image is I(O,O,W,H)

W is the width of the still picture

H is the height of the still picture

The four corner's coordination is (xs[4], ys[4])

xs[0]=0, ys[0]=0

xs[1]=w, ys[1]=0

xs[2]=W, ys[2]=H

xs[3]=0, ys[3]=H

The display area is a four points polygon (xd[4],yd[4])

Then transforming from (xs[4],ys[4]) to (xd[4],yd[4]).

For a point p(x,y) in left plane, suppose mapping to point p′ (x′ y′) inright plane, we can list the simultaneous equation:

x1=x+

 (a[0]*(x−xs[0])+a[1]*(y−ys[0]))/

 (a[2]*(x−xs[0])+a[3]*(y−ys[0])+10.0)

y1=y+

 (a[4]*(x−xs[0])+a[5]*(y−ys[0]))/

(a[2]*(x−sx[0])+a[3]*(y−ys[0])+10.0)

a[6] is coefficients for solving simultaneous equation.

If we display the picture with only a size change, the last formula canbe simplified because the display area is a rectangle (X′,Y′,W′,H′):

x1=X′˜x*W′/W

y1=Y′+y*H′/H

Other filters can be applied and the algorithms associated with theseother filters can be determined according to the intended nature of thefilters and an understanding of the way the algorithms above have beenprovided.

Modifications may be made to the example above as would be apparent topersons skilled in the art of video image manipulation, and to personsskilled in the art of Internet home page design and set-up. These andother modifications may be made without departing from the ambit of theinvention the nature of which is to be determined from the foregoingdescription and the appended claims.

What is claimed is:
 1. A method of relaying digital video data, saidmethod including: providing a first set of digital data of a first framerepresenting a first scene of a video image, assembling data of one ormore filters, and parameters therefor to be applied to the digital dataover a plurality of repeated frames of the first scene, providing asecond set of digital data of a second frame representing a second sceneof a video image, assembling data of one or more filters, and parameterstherefor to be applied to the digital data over a plurality of repeatedframes of the second scene, relaying the first and second sets ofdigital data and the data of the filters, and parameters therefor,together with transition data, On a single file, from a first locationto a second location over a communications medium, and at said secondlocation receiving and reproducing the first and second sets of digitaldata over the plurality of repeated frames with one or more videofilters, and parameters therefor and transition data applied whereby togenerate at the second location an apparent video movie over thosereproduced video frames, wherein said transition data controls the wayin which there is transition between the first and second scenes.
 2. Amethod as claimed in claim 1 wherein the communications medium is theInternet.
 3. A method as claimed in claim 1 wherein the filters includeone or more of ZOOM, PAN, TILT, DISTORT, MORPH, FADE and other effectfilters.
 4. A method as claimed in claim 1 wherein the digital data ofat least one frame is compressed according to a particular codec priorto relaying over the communications medium, and is decompressedaccording to the same codec at the another location.
 5. A method asclaimed in claim 4 wherein a server computer is provided at said onelocation and a personal computer (PC) is provided at said anotherlocation, and wherein the Internet is the communications medium with theserver computer being connected to be accessible as a web site on theInternet, and where the digital data and data of the filters andparameters therefor are downloadable from the server by said PC as“Plug-In” files to the PC.
 6. A method as claimed in claim 1 whereineach scene is part of a 2-D area, and wherein a floor plan of that areais also relayed from said one location to another location so that saidfloor plan can be reproduced concurrently with the apparent video.
 7. Amethod as claimed in claim 6 wherein the floor plan includes arout-of-path line to indicate a path of movement which corresponds withthe reproduction of apparent movement of the apparent video.
 8. A methodas claimed in claim 7 wherein an indicator is displayed with theroute-of-path line to indicate an approximate position on theroute-of-path of viewing at any given instant of playing of the apparentvideo.
 9. A method as claimed in claim 8 wherein timing data is relayedfrom the one location to the another location to define an end pointtime of the line of route-of-path in order that the indicator can betracked to the end of that line at a required time instant.
 10. A methodas claimed in claim 9 wherein there are three or more scenes, each withtheir own data of one or more filters, transitions, and parameterstherefor to be applied to the digital data over a plurality of repeatedframes of the scenes and wherein all the digital data of a single frameof each scene, and the data of one or more filters, transitions andparameters therefor is relayed in a single file from said first locationto said second location, and received and reproduced at said secondlocation as an apparent video including all the scenes.
 11. A method asclaimed in claim 10 wherein said timing data represents a time of changewhen the apparent video movie changes from one scene to the next sceneso that said indicator will reach a change of direction point on saidroute-of-path at approximately the same time there is a scene change inthe apparent video.
 12. A method as claimed in claim 10 wherein digitaldata of each scene, the time durations thereof, filter and transtionsand their start and end times is assembled in one file, datarepresentative of the floor plan of the 2-D area is assembled in anotherfile, and said timing data is assembled in another file, and all threefiles are relayed from one location to said another location as“plug-in” files, and then used at said another location for thegeneration of the apparent video movie.
 13. A method as claimed in claim5 wherein the apparent video is controllable at the another location byPLAY and STOP buttons on a video controller displayable on a monitorscreen of said personal computer.
 14. A method as claimed in claim 12,wherein the digital data of each scene, the time durations thereof,filters and transitions and their start and end times are data ofdiffering file types and wherein said one file has a unique fileextension identifying that it is a file containing different file types.15. A method as claimed in claim 1, wherein the transmission time overthe transmission medium is less than that required to transmit digitaldata of a video movie of the same content if digital data of all ofthose reproduced video frames were transmitted.